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The theoretical basis of programned instruction and 
the sequential skill development approach used at University of 
Louisville's Oniversity College are describedr and results of student 
testing to determine the effectiveness of programmed instruction in 
the school's remedial program are examined^ Nine areas of basic 
competencies -needed for college that relate to cognitiver affective, 
mechanicalr a^id psychophysical skills are identified. The remedial 
courses are programmed in small stepsr and individualized instruction 
is used to promote sequential skill development. Nine hierarchies of 
competence in higher order cognitive processes that have been 
proposed by investiaators are presentedr and theoretical issues are 
analyzed. The Watson-Glaser Critical Thinking Appraisal was 
administered to students enrolled in remedial courses and students 
enrolled in a general education course (social sciences and 
humanities) to determine the effects of programmed instruction 
provided in the remedial program.. The general education course did 
not provide the incremental ■ drills characteristic of programmed 
learning. Student? in both groups had similar characteristics. 
Pretesting and posttestina with the Watson-Glaser test indicated that 
students enrolled in the listening and comprehension and the critical 
thinking remedial courses increased their mean scores more 
significantly than did other students. This finding is atrributed to 
the instructional formats of these courses. References are included. 
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The Role of Pro{;ramnied Instruction f,ox 
Sequential Skill Development in Higher Education 

Competent, responsible management of society in the future requires a 
college-educated citizenry. Such a claim is not elitist; rather it reflects 
the traditional and contemporary value placed on higher education. In an 
egalitarian society, higher education can be made- available to whoever aspires 
to it. However, which skills are prerequisite for entry into college, and which 
skills are to be developed within college have not been adequately studied in 
our society, for the language of education has only begun to speak of measurable 
competencies. Determining the nature of these skills will allow the design 
of educational programs in both secondary and post-secondary education which 
form a continuum of skill development. The competent citizen must, beginning 
his education in childhood, sequentially develop skills which lead to the mature 
cognitive, affective, interpersonal, social, and psychophysical performances 
irequired of him as an adult. ^ 

The recognition that education, even at the college and graduate levels, 
is the development of skills which enable one to acquire, produce, and utilize 
knowledge, is the first step towards a competent society. Recently, higher 
educators have recognized this and have sought to encourage new developments 
in college curriculci which will respond to this challenge. The Carnegie 
Foundation for the Advancement of Teaching, in discussing the importance of a 
broad exposure to the liberal arts, names three essential characteristics of 
a sound uiadergraduate !iducation (Carnegie Foundation for the Advancement of 
Teaching, 1977, 165): 

1. Builds skills for advanced studies and lifelong learning. 

.2. Distributes time available for learning in such a way as to expose 

stJdents to the mainstreams of thought and interpretation — humanities, 
science, social science, and the nrts, 

3. Integrates learning in ways that cultivate the student ^s broad under- 
Standing and ability to think about a large and 'complex subject. 



A. Senuentilal Skill Development at University Concr.c, University o f Louisville 

The majority of students enrolled at University College of the University 
of Louisville are "open admissions" students who have composite scores below 
18 on the American College Testing Program (ACT) examination. We have established' 
a Developmental Education Center at University College which does research 
into^the higher cognitive and affective skills necessary for successful 
achievement in college and develops competency-^orienLed curricula in 
introductory and advanced courses in the humanities, social sciences, and natural 
sciences, so that the skills we ident?.fy can be explicitly taught and assessed. 
Our effort extends to identifying the skills prerequisite to adequate college 
performance; thus, we offer a remedial program of higher cognitive, affective, 
mechanical, and psycho-physical skill development. 

We have identified nine areas of basic competencies that underlie college 
level performance. These are 1) self-concept and motivation; 2) reading; 
3) quantitative skills; 4) oral communication and group behavior: 5) wit ten 
communication; 6) basic information (political, demographic; geographic; and, 
historical facts); 7) mechanical skills (using audio-visual aids, typing, using 
computer terminals, etc.); 8) critical thinking skills; and 9) research skills. 

These remedial areas can be seen as part of a continuum of skills and 
information which have their higher order equivalents at the general-education 
levell. (See Appendix A.) 

Our courses are competency-oriented at both the remedial and general 
education level. The general education courses stress the skills of academic 
inquiry within the social sciences, humanities, and natural sciences, skilliS 
generic^ to the disciplines within each major division; for example, in the 
social sciences we stress the formulation of re.searchable questions, concept 
development, data gathering methods, and data analysis. The junior-senior 
courses offered at University College form part of a bachelor degree program in 
liberal studies, an interdisciplinary degree whose foundation is the "generic*' 



skill general-education courses. We are continually seeking to define the 

more complex skills that are integral to this higher level ':tudy. Viewing 

higher order cognitive psychophysical, affective, interpersonal, and social 

processes as points on a continuum of skill development helps us to identify 

the skill clusters that make up the independent thought and research which are 

Integral to the junior-senior levels. (See Appendix B.) 

B. Individualized Instruction and Sequential Skill Development 

To learn skills in sequence, one set of operations must be mastered before 

another set can be learned in the skill continuum. We are interested in 

validating (as well as benefiting) fi'om the research of those educators who 
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have identified such "hierarchies of competence" in higher order cognitive 

processes. Table I shows six classes of these processes; classes I-IV may 

be Viewed developmentally as a movement from basic to more complex skills 
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accomplished in childhood and adolescence. Classes V and VI are operations which 
are brought to the synthetic products of Class IV. 

The most effective means of instruction for developing a competence is one 
that provides explicit opportunities for its exercise, and a means of assessing 
Its mastery performance. Individualized instruction is one methodology which 
has been used effectively in the development of human skills in this sequential. 
Incremental manner. 

Individualized instruction is a learning experience designed for the 
individual rather than the group. It presents its content through formats that 
permit the individual to manage the material selected for study, and to exercise 
a particular skill at the pace which most suits his competence level. 
Effective individualized instructional materials guide a student's progress from 
One phase of learning to another, signaling him vhen he has mastered a concept 
OX skill. Thus, individualized instruction permits the student to control his 
learning experiences, and a logic that steers and reinforces successful learning. 
The notion of incremental steps, which lend the student sequentially from 



TABLE I 
(Thomas, 1972) 



Taxonomies of the Cognitive Domain,^^ 



ClUSJtS Of HIGHER 
OflOfftCOCHITIVE 
PROCESSES 



I 

UARfilNCTO 
UARIiPRC.ESSK 



li 

C9b(iitUNtCATlON 
PROCESSES 



tlASSJFYlNCANO 
CCVPARINC 
PROCESSES < 



Bloom, BS.. II tK ^9S6 
ICognidviObjMM 



IV 

SYNTKE5I2INCANO 

paooticiNC 

PROCESSES 



Corr>p*fing 



EVALOMIHG 
PROCESSES 



VI 

VALUE ANhlYSlS 
ANOOEClSiO« 
WARING PROCESSES 



Ability 10 Elitjoriie 

Cffy»ii'/'ng 
S<r. vtiviytoP'OOj^ 

Crii»ci;>^0 
jriffpfei'og Oiti 



Burnt. fl.W.ind 
G,O.BimI»i.1970 
ICogniiiviProcttWrtl 



AppliCJliOrt 



[gulling 
Anjly/ing 



£yalu4lion 



Synl^iCJi/inj 

Simuliiing 

Tunilaii'^^ 



Inlnnng 



Cole. H,P., 1969 
llntillJCiuilPTOCtttfil 



tijttnmg 

OifecionFollav»infl 
ObJcfvat'OnSkJlii 



TfanjiDinaiiof^ 
FijufalOecoJing 



ClaiiilMtKjn 

AUti'juttldentilicJ 

SffidlOfdcrinQ 
lic^aiion 



Fiet.biiiiy aod 

Divct. Inicrgfclitori 
Oiitr Production 

DKtnifaiion ''• 
inQifi'y 



Gtrhird.Mj87t 
(CognitivfStnttginl 



Guilfofd.jr.K67 
ICognidviAbililin) 



H>lli.J.Lj9eQ 



Cogniiion 



RiIHU «iU^9«' 



CUuifying/CaltQon/ing 
Concfpt Fofmition 

Anilyvi 



AuOCOliDC 
IftludiveReaDniftg 

PMSonirg 
,yr^ih«ii 



ClJUifyiog 



Sty*;* 



OivB<owt Thinking 



P/«dicitf^ 



KVilir^ l'''<*'^'fl 
GrntfjliNtont 
Op«.uc'vi Defining 
T«l»r^/iHyiOlMiJ 



Valuing 

OKiVon Mining 
Poiny Wat'«g 
Con<eytuJt'/atiOflOf 

Vai»^n 



CiwiN*'»fl 

iPlfD'lt'^ 



HyDOl'vft':!^ 

Aoc'n'^f'C^'*'^ 
Pfif^oieitnNf*, 

S.iuaiom 
OeiijningfVoiJCli 
or If>v«il^t0'^» 



Coding 
C/iUi/ing 

Looking lO'Att'^^^ 
I cm 

CoiiKi'ngmdOga^i" 



OfCiiOflWAtrg 
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onc learning task to the next, iy often called procrnninicd learning, Not all 

individualized instruction works with incremental steps, however, Jerome 

Bruner writes of prograirancd instruction (Briggs, 1978, 21-22). 

There is in the current doctrine (I will call it)' of prograiraned instruction, 
the id ea ft*.hat somehow you should take small steps, that each increment should 
be a small step. Now, this idea is derived willy-nilly from a theory 
of learning which states that learning is incremental and goes in small steps. 
Nowhere in the evidence upon which such a theory .is based — and it is only partial 
evidence — nowhere is there anything that says that simply because learning 
takes place in small steps, the environment should be arranged in small steps. 
In doing so, we fail to take sight of the fact that, indeed, organisms from 
vertebrate on up through the highest primate, man, operate by taking large 
packets of information and breaking these down into their own bite size and that 
unless they have the opportunity to do that, learning may become stereotyped... 

Thus, Bruner shies away from tight programmed sequences in his approach, 

although, for him, individualization is critical in education. Bruner lists 

four key features of any instructional theory, all of which reinforce 

individuali^iation (Bruner, 1968, 40-41): 

1* A theory of instruction should specify the experiences which most 
effectively implant in the individual a predisposition toward 
learning. 

2. A theory of instruction must specify the ways in which a body of 
knowledge should' be structured so that it can be most readily grasped 
by the learner. 

3, A theory of instruction should specify the most effective sequences 
in which to present the material to be learned. 

4* A theory of instruction should specify the nature and pacing of 
rewards and punishments in the process of learning and teaching. 

Bruner goes on to specify six ways to individualize curricula effectively 
(Briggs, 1968, 22); "a) arrange it that the student grasps the structure by 
induction from particular instances; b) give practice in transfer when transfer 
Is expected as a result of learning; c) use contrast in the sequence; d) avoid 
premature symbolization; provide for images first; e) give practice in both 
leaping and plodding; small steps are sometimes necessary, but without great 
leaps involving guessing a (student) is deprived of his rights as a mind; 
f) provide for revisiting — through use of spiral programs so as to not expect 
that the full value of a matter being studied is grasped always in a single 
O Mock like a linear sequence," These six J.nstructional design principles are 



Integrated into, our general education level coursey which introduce academic 
inquiry in the sciences and humanities, Some of them, such as spiral 
development in skill learning, and the use of concrete instances to enhance 
induction, are also used in the remedial, programmed courses. The general 
education level courses, however, are closest to the non-programmed guidelines 
of Bruner. The major exception to Bruner's position we take in the general 
education level courses is our use of structured worksheets which guide the student 
even during independent field research, 

Robert Gagne'^, another prominent educator involved with individualizes? 
education, differs from Bruner in that he supports the identification of 
small sequential phases that methodically lead the student to mastery of a 
clearly defined skill. Gagne places strong emphasis on the hierarchies of 
competence in higher cognitive skills (as well as in other human ability areas) 
which can be shaped through i'\:e instructional sequences that are permitted 
by programmed, individualized learning, (Briggs, 1968, 20-21.) 

Bruner^s allowance for leaps of inference and original creative work on 
a problem, within individualized instruction, is important to academic inquiry, 
but, without Gagne 's stress on hierarchies of competence, no adequate basis 
in lower-level skills for such higher-level performance would exist. 
/Thus, in our general-education level, project-oriented courses incorporate 
Bruner *s principles of individualization, allowing the student to formulate a 
personally meaningful research question, and to conduct his ox^ inquiry to 
develop an answer. However, a student cannot effectively pursue such independent 
work without a thorough mastery of the lower-level skills in this "hierarchy 
of competence." Our remedial courses, which are programmed in small steps, 
njake the general education level "great leap" courses possible. 

The value of programmed instruction lies not only in the care one may 
exercise in the incremental development of a specified skill, but also in 
certain cognitive and affective skills which are the outcome of such focused 
learning. Programmed instruction develops not only the skills which are the 
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subject matter ol; the instruction«il unit, but also the process skills which 
are Iniparted by the characteristic method of this instruction. These are 
the "learning to learn" processes (Thomas, 1973) ond the basic critical thinking 
operations (Thomas, 1973) which are prerequisite for more complex skill 
learning, fundamental skills lacking in many of the students who attempt 
higher level courses. By offering remedial courses in essential academic 
areas (e.g., vocabulary, spelling, standard English usage, etc.) and 
delivering this instruction via a mode of study that also produces the 
"process" skill development, we achieve a rapid increase in the student's 
capacity to meet the denands of general-education level skill proficiency. 

v^everal ''learning to learn*' processes and low-level critical thinking 
skills acquired through exposure to programmed instruction have been identified 
in past decades of educational research. A summary of the effects claimed 
include; 

It Self-reliance and personal management of the learning process : 
(Garner, 1966; Russell, 1974) 

The student acquires confidence in his ability to choose instructional 
materials and methods without the stimulus of an instructor. He acquires 
this ability as the result of self-directed progress \j±th progidmrued 
materials designed so that he can identify the learning sequences necessary 
for mastery of a content or skill area, locate the necessary units and materials, 
and evaluate his own progress. 

2, Anxiety control in the learning process ; 

CWt J. Carr, 1959; Liebennan, Yalom, and Miles, 1973) 

.The student learns to govern anxiety as the result of his own control 
over the amount of work done, the timeinwhich it is completed, and the clear 
and reliable reinforcement for work accomplished. The objective criteria 
for successful achievement, as x-jell as for work that must be corrected, 
allows the student to accomplish and value' his activity without filtering his 
effprt through the subjective presence of the teacher* 

3t Facility in followin<^ complex routines and procedures ; 

(Garner, 1966; Briggs, 1960; Russell, 1974; Fowler, 1967) 

Practice in following the detailed, thorough procedures necessary for an 
effective, programmed instructional unit, develops in the student the ability 
to mentally and psychophysically interpret such logical maps in any context. 



Er|c, ^0 



4, P ositive nt'tiltudc dovdJoped toward ]carninr> ; 
(Garner, 1966, Russcdl, 1974) 



The iraniodiatc, certain reinforcement received in learning through 
programraad units stiniulatcs the production of a positive attitude toward 
the content learned, an attitude that carries over to any learning achieved 
through the same or similar instructional system, 

5. Recognition of a personal lenrnin;^ style ; 
(Garner, 1966; V7. J. Carr, 1959;' Russell , 1974) 

The self-management involved in learning with programmed materials 
enables the stiadent to become familiar with personal preferences in the time 
given to study, and in the division of time allotted to problem-solving, 
reflection, evaluation, and correction of one's own work. 

6. Ability to attend to specific detail and discern differences : 
(Briggs, 1968; Russell, 1974;. Fowler, 1967; Gagn(£, 1968) 

The close reading entailed in following the directions and subject 
^matter in a programmed unit provides constant practice in discrimination. 
The intensive attention to detail cultivated by a carefully programmed unit 
cannot be duplicated in a solely teacher-directed course*. 

7# Concentration and av/areness in task performance : 

(Briggs, 1968; Smith and >loore, 1965; Gagne, 1974; Russell, 1974) 

The clarity of objectives, questions, and response procedures in the 
programmed unit develops an "attentional set" in students which enables 
them to sustain concentration over increasingly long periods of time. 

8. Simple critical thinking discriminations, i.e., distinguishing fact 

from opinion, making inferences from facts, sorting and classifying, etc . 
(Garner, 1966; Briggs, 1968; Fowler, 1967; Gagne, 1974; Thomas, 1972) 

The coherent, logically sequenced questions which lead students step- 
by-step through a programmed unit, lend to the development of critical thinking 
competencies which enable simple discjrimination and inference. 

The promise of development in these process skills led, in part, to our 

use of comraerical and original programmed . instructional units to teach 

remedial academic skills to students. In order to determine whether these 

''eight process skill areas are part of student skill growth, a progrsiQ of 

pre- and post-testing has begun that attempts to measure entry and exit levels 

of these process skills as students engage in the programmed instruction. 

The claims made, by proponents of programmed instruction must be tested with 

appropriate mea^res.. We are gradually locating instruments with which to 

evaluate these possible benefits. 
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C . Testlp;; to net:crinlnc ti.u Kf foct.q o j: JV.^^^'^^^^^^^^^^^^l^ 

To test the effects of progjrnmmed students enrolled 

In oi r '.•e.-nedial program, in tl)e Fall, 1970, ^^*^^^ified measures which Would 
test the claims of hypotheses six throtjgh tJ^^'^*^ ^^bove) . Out experimental 
group consisted of students enrolled the ^*^""^^5-al courses. Our control 
group was selected from students enrolled ^ ^^^current general-education 
level course introducing the social scien<ie^ ^^manities. students in 
both groups had similar characteristic^. 

The remedial courses are individuali^od banner suggested by Gagne: 

their content consists of sequential siaU^ ^^""^^ are developed in a programmed 
manner; the student is guided step-by-^tep (^^^^"^^ dxxll activities towards 
mastery in each skill at a certain lev^a c/ P^^^°^ance. The general education 
level course in inquiry is somewhat in^i.vi^v'^^^^^^ . incorporating t^e principles 
of Bruner. It is a project-oriented cQu^e ^^^^ ^^gages the student in actual 
research. While it has worksheets to ^'^"^^^t wotk in phases of academic 

inquiry, the incremental drills characte^i^t^*'^ ^^ct^rarmed iearnioS are 
absent. The remedial courses in the Fall, i^^^ 

DEC 060 SPELLING 3 credits. An individu^^^'J' ^elf-instrnctional course 

in standard ^^Engiish spelling. 

DEC 063 VOCABULARY DEVELOPOT 3 credits. ^ JjJ^ividualized course 

designed to student expand bis under- 

standing an4 ^ Spoken and v,ri'tten 

English. 

DEC 065 STANDARD USAGE 3 credits. An indiv^f ^^J^ed, self-in^truction course 

in the sta^d^^ noun° ^o^°n American-English 
V^tt'^rns (e.^' ^ plurals, possossi^es, verb 
tenses at^d f(?j: °nouns, adjectives, adverbs, 



etc.) 



DEC 070 LISTENING AND CONCENTR.\TION 3 cfc^^''";^^^ ^^If-instr^ctional, 

individue^lizet^ nd co? ^^^^ovxns listening 
comprehet^s ion ^'^'^ntration. 



DEC 080 CRITICAL THINKING 3 credits. /Vr^ l<^epf^^^='-^d course which helps 

the studQnt; t<7 ^.^^^J^te facts Stom opinions, 
draw infe3r^^nc<? .[.g ^^t-^tely report phenomena 
and make jud^m ^sod on logical criteria 
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Evaluation of content mastery within each couirse JLs deteirinined by successful 
completion and cprirection pf the exercises which build information and skills 
Incrementally, and by periodic mastery examinations. 

The "learning to learn" processes and low level critical thinking skills 
claimed as outcomes of programmed instruction (hypotheses six through 
eight) were ey:iluated by pre- and post-testing students in both the treatment 
0nd control grcv.-? with the Watson-Glaser Critical Thinking Appraisal , These 
low-level critical thinking skills and "learning to learn" processes are 
discussed in the literature of critical thinking (Thomas and Taylor, 1975; 
Thomas, 1973), The Watson-Glaser Critical Thinking Appraisal is composed of 
five tests, designated as Inference., Recognition of Assumptions, Deduction, 
Interpretation, and Evaluation of Arguments. Distinguishing fact from opinion, 
and inferring from iact and opinion underlie each of these five divisions, 
thus can be seen as the lower level skills we wish to measure. 

The control group, drawn from the course introducing the social sciences 
zTk^ humanities, was exposed to an instructional design which assumed previous 
mastery of these lower level skills. The course required students to complete 
an individual research project in both the social sciences and humanities. The 
more complex critical thinking skills required in this course included the 
. synthetic (or knowledge production) skills (Blum and Spangehl, 1978) of 
• foirmulating researchable questions, developing adequate and loj^ical research 
designs, gathering data with appropriate research methods, and evaluating 
the data in light of the questions to be answered. None of the students in 
the control ^roup had been exposed to the remedial courses before this semester 
or during the semester. (Thus, we could not assume they had mastered the 
necessary lower level skills.) 
D, The Results of the Study 

In the following tables we show the results of the pre- and post-testing 
given the treatment and control grcip with the Watson-Glnser Crlttcnl Thinking 
^ A ppraisal , 
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TABU- II 



Form YM of the Wntsoii-(;]nser wns used as a pre- test nud Torm ZM as 
a post-test. The ZM score;; were converted to YM score.'; /n cordinc to iJie inrjtructJon 
manual for the test, and the change in Wnt.son-Claser i;cor<' over tlie semester 
was calculated for each student. These changes are ati follows: 



HE/;)] chai:gt> III \ihTr.o:ucijsxu cnTTic/j, 
PoI'ULA'J'IOj.*;;, j-ViLl sij ji:3teh 1970 - 1979 
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Ji'M. ctuiicntc' 




0.766 


7.ti91 


UtC OC-0 Treatment • * 


3 


/I.333 


7.552 


UKO OSj; Trcntir.ent' ' 


17 


2.794 


7.155 ■ 


DEO OS;? Tre.-jtincn;;' * 


5 


/i.lOO 


C.340 


UBC Oyo TreatKcrjf * 


10 


8.600 


5.675 


WiC OiiO liTcatncni-' * 


11 


7.727 


5.502 


LliS'i' 101 'iTeatinerjt- • 


63 


-1.405 


7.746 



*!rhDS gro'up j.nclv:dcr. all those v;ho tooi: the VJatcon-Glascr Critical 
O^hinking Appr/dsal .at the "bcEinning and end of the Fall 197B - 1979 
Semester and rcciotered for any of the follov;inG courses: DEC 060, 
DEC 065, 06!?, DEC 070, DEC OSO, LEST 101, and LEST 105 . 



**!rhcr.e groups include only those uho took the VJatson-Glascr Critical 
Ihinl:i3:)g Appraisal at the beginning and end of the Fall 1978 - 3.979 
EeiDester and \;ere exj^osod to trcatinent; in the courses specified. 
Ibrposure to -xreatincnt; v:as defined as receipt of t}ic following course 
grades: A, B, C, or 1; non-tD^catjuent v:as defined as receipt of 
the rollov;ing course grades: F^ V/, 
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Aiuilyr.^n oS vorinnce for ntudcnLfi tzjVJn;-. hUO OVO niid j)i:C OfJO indJcttnn thnl: the: 
dlf/crcjicco In idcou iiic:rc/icc on tht ValuowGluLtv CrlLlcal Tl»Jiikii)f; Aj>i>ralD<il urc 
oltnlllcnnt: 



$tuc3cntc treated In 10 8.6000 
DEC 070 

Students not treated in OA -0«1667 
J)EC 070 

Students treated in 11 7.7273 
DEC 080 

Students r.ot treated 83 -0.1566 
in DEC 080 



df 



5.675 92 
7.616 

S.*502 V 92 
7*718 



3.52* 



3.27^* 



*Blp,nifj.cant at the p<.001 level 
^^cigntficar.!: at the p<.005 level 

In addition, analycir? reveoln.that the difference in mean increaaec for ctudents 
taking lab courses versus students taking non- laboratory courses is also significant: 



df 



Students treated in 
LBST 101 vho u'ere not 
concurrently enrolled 
tn any DEC lab course 

Students treated in lab 
courses vho vcrc not 
concurrently enrolled 
in LUST 101 



63 



30 



-1.A0A8 



5.1C33 



7.7/i6 91 



6.352 



-4.05* 



*ciAuilicant r.t the p<.0OI level 



TABLE IV 



The chart below makes these changes clearer and displays the inter- 
relationship between DEC 070 and DEC 080. 

CHAUGE IN TjATSON - GiASER CRITICAL THINKHTG APPRAISAL SCORE 
. BROKEN D0I7N BY XREAT^S^TS RECEIVED, FALL SE-IESTER 1978 - 1979 



Total Population 
mean = 0.776 
n n S4 




Students treated 

in DEC 070 

mean = 8.600 
n « 10 



Students treated 
in DEC OSO 



mean = 7^727 
n = 11 




Students not treated 
in DEC 070 or DEC OSO 
mean = -0.9S7 
n « 75 



Students treated 
Only in DEC 070 
mean « 7.625 




Students treated in 
both DEC 070 and DEC OSO 
mean = 12.500 
a « 2 
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Students treated 
only in DEC OSO 



mean = 6.667 
n « 9 



E« Dl3cu£>?;lon 

The most significant Increases in mean score were f.ox those students 
taking DEC 070 (+8.6) and for students taking DEC 080 (+7.727), 

Interesting, though statistically insignificant, were two students 
who took both DEC 070 and DEC 080 and who showed a mean incrc^ase of 
+12.5* This may indicate a combination of treatments is educationally 
superior to separate courses, although raorestudyis necessary. 

The increase in DEC 080 is to be expected. The course specifically 
deals with the skills tested by the Watson-Claser , The instructional format 
of this course consists of structured lessons which drill the student in 
specific critical thinking competencies, such as ' distinguishing fact from 
opinion, making inferences from verbal and visual facts, interpreting 
reports, sorting and classifying information, making comparisons, constructing 
analogies, etc.. The course materials in their content and graphic design 
set clear objectives, provide guidance in giving specific answers, and 
emphasize repetition and reinforcement, exhibiting generally the 
characteristics of instructional format that are said to produce the results 
claljued in propositions six through eight. 

The increase in DEC 070 was less expected.^ The content of the course is 
liatening skill, not critical thinking. However, the instructional format 
has the above characteristics of clarity in objectives, repetition, and 
reinforcement, etc., of standard, well-designed programmed materials. 
The course content is designed to train students in short and long term 
wemory and to increase the student ^s ability to concentrate on and retain 
Information presented orally. There is no specific skill taught that is 
tested on the Watson-Glaser Critical Thinking Appraisal . Therefore, we can 
Infer that the substantial increase can better be explained by the in- 
structional format than the course's content. The skills described in hypotheses 
six and. seven seem to contribute strongly to success on the Watson-Olascr . 
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The competency of "attention'* which enables a student to comprehend 
clearly stated objectives and to make accurate responses, is explicitly 
part of the DEC 070 course content; it trains the student to focus attention, 
to respond as accurately as possible to a question. Attention to specific 
detail, and the discernment of difference is also a major empHasis. Thus, 
although the low level critical thinking skills were not taught (those skills 
asserted as outcomes of programmed materials in hypothesis eight), performance 
in questions that drew upon such skill competency was high. We infer that 
"attentional set" may have more to do with success in such low-level 
critical thinking than even specific training in the skill operations 
themselves. 

There was a small but respectable increase in the Watson-Glaser scores 
of students who were enrolled in the other DEC courses, although the content 

of these courses bore no relation to the skills of critical thinking included 

I 

In hypothesis eight, or tested explicitly by the Watson-Glaser. In these 
courses, the instructional format was individualized and programmed. The 
effects must be seen as resulting from the skills claimed in hypothesis six, 
those that lend to attention of specific detail and the discernment of 
differences, and, to a lesser extent, the skills claimed in hypothesis 
seven, the ability to attend to and perform specific objectives. 

The lack of significant gain in the LBST 101 course is not puzzling 
when one considers the structure of the course and the fact that students 
Who take the course have not yet been carefully screened for prerequisite 
skills, \7hile the LBST 101 course does rely on structured worksheets which 
can provide the type of detailed, adherence to clear objectives demanded by 
programmed materials, the course as a whole allows much more self-initiated 
inquiry. In order to complete the social science and humanities projects, 
complex sicills such as planning and carrying out research designs and compiling 
and reporting results are required. The Watson Glaser tests lower level 
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skills, which should be used in the process pf the LBST 101 course when 
^ gathering facts, inferring from facta, and evaluating results, but the 
students are not explicitly trained in these specific skills in the course, 
nor does the course have enough of the repetition and reinforcement offered 
by programmed materials to develop these skills through instructional format, 
Thus^ hypotheses six through eight will hold for individualized , programmed 
instructional formats, but not for a more open, inquiry course. 

We plan to augment the LBST 101 next semester with more programmed , 
repetition and reinforcement activities in order to achieve the gains in 
lower-level critical thinking which appear to be the effects of such an 
instructional format. We can incorporate this approach at the points 
Vhere students begin to plan their research design, where they compile 
results, and where they prepare to infer from the facts they have gathered. 
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APPENDIX A 



onJi'Cnvi;^ vor Di;vj;i,orMKNT and i)-nii;vj:i,oJ'Mi:MT 

; • . OI'IJIIATIOH 01' COUIUiJi, 1979-1902 • . 0=OrJ'l{A'J'iON 

COURnKS ^ lOyp-fiO ]9r)0-Sl .19n]-82 

DEC 001 Orlontatlon • 0 0 0 

, DKC 050 Presentation Skills , D 0 

*^DEC 059 Listening and • ' 

Concentration 0 • 0 0 

*DEC 060 Spelling I 0 0 0 

*DEC 061 Spelling II -000 

s^DEC' 065 Standard Usage ' • 0 * 0 ' 0 . ' 

DEC 068 The Mechanics of VJriting D* * 0 0 

4 

DEC 069 Basic Organization in • . 

. * Writing DO 

*DEC 073 Vocabulary Development I .0 0 0 . 

*DEC 074 Vocabulary Development II 0 0 0 

DEC 075 Basic Facts in World Events • D 0 0 

*DEC 080 Critical Thinking I ' 0 0 0 * 

DEC 081 Critical Thinking II ' D .• 0 . 0 

DEC 090 Research Skills: . . • 

Taking Notes * D * 0 

DEC 091 Research Skills: 

Questions. D 

*Denotes courses developed and in operation before 1979-80 academic year 
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OnJlCCTTVI-S KOK DI'VI-I.OPMKNT AND 
OPEKATIOM Or.COUK:;iiS, 1979-1982 



O^OJMilKATJON 



COUKSl'S 



1979-aO 1 980-8 1 ]9n.1-P>2 



LBST 101 Ideas & Research; Creative 
Expression 

*LBST 102 Ideas & Research: 
Behavioral Studies 

LBST 103 Ideai; & Research: 
Scientific Studies 

*LBST lOA Case Studies in Creative 
Expression 

*1,BST 105 Case Studies in Behavior 
and Institutions 

LBST 106 Case Studies in Science 
and Technology 

*LBST 110 Academic Library Research 

LBST 2j1 Guided Reading, Reporting:. 
Creative Expression 

LBST 202 Guided Reading, Reporting; 
Behavioral Studies 

LBST 203 Guided Reading, Reporting: 
Scientific Studies 

IBST 250 Independent Reading in 
Interdisciplinary Areas 

LBST 299 Independent Projects in . 

Interdisciplinary Areas 



D 



0 



0 



0 



0 

D 
0 

D 

D 

D 



0 
0 

0 

0 

0 

0 
0 

0 

0 

0 



♦Denotes courses developed and in operation before 1979-80 academic year 
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Population Studied 

The population studied included 242 students — all those taking courses 
under the direct control of the Deyelopraental Education Center during the 
Fall Semester of 1978 - 1979. Of this group> 139 (or 57.4%) were males, 
and 103 (or 42.6%) were females. Of the 166 students for 'whom we had full 
Information, the average age was 20.6- years; the* standard deviation was 
5.86 years, making this a varied age group. (Year of birth varied from 
1905 to 1961.) For those on whom standardized national test scores were 
available, the means were far below national norms; there is no reason to suppose 
that those for whom test scores were not available would, if tested, increase 
the means in the table below: 



SELECTED CHAR/\CTERISTICS 
OF POPULATION STUDIED 



KEASURE 



KEDIi^JT SD 



ACT Verbal 
Section 


10.255 


9.BI3 


It 

4.175 


1.0 


23-0 


98 


ACT Math 
Section ^ 


8.673 


8.500 


4.771 


1.0 


33.0 


98 


ACT Social 
Science 
Eeading 


■9.153 


8.053 


4.264 


2.0 


25.0 


98 


ACT Katiiral 
Science 
Reading 


13.276 


13.167 


4.814 


2.0 


30.0 


98 


ACT Composite 
Score 


10.495 


10.150 


3. 819 


4.0 


30.0 


98 


SAT Verbal 
Section 


285.56 


296.25 


56.59 


220 


410 


9 


SAT Qucmti- 
tative 
Section 


301.11 


280.00 


66.79 


230 


410 


9 
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Foc>t;notos 



The development nl perspective which guides the research end teaching 
reported in this pnper adheres to the ideas of cognitive and affective skill 
development di.<>cussed by Jean Pinget, Robert Gagnc, and others who have 
researclicd the dcvelopmenta.T stages of competency I'n the light of human 
maturation. For a more thorough discussion of skill development within higher 
education, see Blum and Spangehl, "Developmental Education and the University 
college: A Competency-Based Approach to Education," Resources in Educa tion, 

Washington, D.C.: Health, Education, and Welfare, National Ins t ituti~^f 

Education, December, 1978 (ED 157813). 

2 

Generic skills are those which are used throughout a discipline or 
division of knDv;ledge, as opposed to specialized procedures which are 
developed to aid a particular experijiient . A generic skill is a procedure, 
to be sure, but one that is transferable to any problem within a field if 
its data gathering methods are appropriate for the problem. See Blum and 
Spangehl (December, 1978) for a discussion of procedures and skills; see 
Gary Uoditsch, Developinp Generic Skills : A Model for Competency -Based 
General Education, CUE Project, Occasional Paper Series No. 3, Bowli^^i~ 
Green, Ohio: Bowling Green State University, May, 1977, for a presentation 
ox the concept of generic skills." 

3 

The idea of "hierarchies of competence" has been explored in the research 
of Robert M. Gagne over the past two decades. A partial bibliography of 
his writings appears in this paper. Leslie J. Briggs writes an informative 
overview of the ins:ructional implications of Gagn^'s works in his book 
identified in the bibliography. John W. Thomas' creative work in programmed 
instruction at Research for Better Schools, Inc., a federally funded 
research and development laboratory that develops curricula in elementary 
and secondary education, follows closely the work of Gagne. His taxonomies 
of sequential higher cognitive skill development appears in Vari-ties of 
Cognitive Skills; Taxonomies and Models of the Intellect ; other worksTy 
him are also listed in the bibliography of this paper. 

If 

Thomas warns that such a presumption is not yet validated, and can only be 
posited for the type of study which might bring validation. He writes: 

The ideal result of this analysis would be a continuum of cognitive skills. 
That is, instead of three taxonomies (classifications), the taxonomies would 
be integrated such that hierarchies would emerge within and across specific 
skill clusters. Instruction in memory skills would proceed from simple 
prerequisite skills to complex, more differentiated skills. Skills taught 
in isolation in early grades, e.g., listening skills, would be taught in 
conjunction with other skill areas in the later grades, e.g., listening skills 
yith critical thinking skills. Again, this kind of organization could be 
Vq?^^ 99"??? analysis only with great risk to its validity." "(Thomas, 

\homas (T973, 22-23) does claim that a combination of listening skills and 

critics thinking skills may be effective in promoting critical thinking 
^development. His suggestion is made in the light of hierarchies of 



24 



competence, Ifstenlng skills being a prerequisite for the facility in criticcal 
thinking. He does not say why this combination might be effective; our 
analysis is that concentration developed in listening may be a "learning to le 
process necessary for the focused thinking of critical thinking. 
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